I 



Attorney Docket No. PU01003 3 



REDUCING SPARKLE ARTIFACTS WITH 
LOW BRIGHTNESS SLEW RATE LIMITING 
Background of the Invention 

1 . Field of the Invention 

5 This invention relates to the field of video systems 

utilizing a liquid crystal display (LCD) , and in particular, 
to video systems utilizing normally white liquid crystal on 
silicon imagers. 

2 . Description of Related Art 

10 Liquid crystal on silicon (LCOS) can be thought of as one 

=i large liquid crystal formed on a silicon wafer. The silicon 
;f wafer is divided into an incremental array of tiny plate 
:! electrodes. A tiny incremental region of the liquid crystal 
ji is influenced by the electric afield generated by each tiny 
b.5 plate and the common plate. Each such tiny plate and 

corresponding liquid crystal region are together referred to 
Tt as a cell of the imager. Each cell corresponds to an 
=f individually controllable pixel. A common plate electrode is 
21 disposed on the other side of the liquid crystal. Each cell, 
"20 or pixel, remains lighted with the same intensity until the 
input signal is changed, thus acting as a sample and hold. 
The pixel does not decay, as is the case with the phosphors in 
a cathode ray tube. Each set of common and variable plate 
electrodes forms an imager. One imager is provided for each 
25 color, in this case, one imager each for red, green and blue. 

It is typical to drive the imager of an LCOS display with 
a frame-doubled signal to avoid 3 0 Hz flicker, by sending 
first a normal frame (positive picture) and then an inverted 
frame (negative picture) in response to a given input picture. 
30 The generation of positive and negative pictures ensures that 
each pixel will be written with a positive electric field 
followed by a negative electric field. The resulting drive 
field has a zero DC component, which is necessary to avoid the 
image sticking, and ultimately, permanent degradation of the 
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imager. It has been determined that the human eye responds to 
the average value of the brightness of the pixels produced by 
these positive and negative pictures. 

The drive voltages are supplied to plate electrodes on 
5 each side of the LCOS array. In the presently preferred LCOS 
system to which the inventive arrangements pertain, the common 
plate is always at a potential of about 8 volts. This voltage 
can be adjustable. Each of the other plates in the array of 
tiny plates is operated in two voltage ranges. For positive 
10 pictures, the voltage varies between 0 volts and 8 volts. For 
Q negative pictures the voltage varies between 8 volts and 16 
m volts . 

;=J The light supplied to the imager, and therefore supplied 

111 to each cell of the imager, is field polarized. Each liquid 
'Ms crystal cell rotates the polarization of the input light 
! L responsive to the root mean square (RMS) value of the electric 
ii| field applied to the cell by the plate electrodes. Generally 

speaking, the cells are not responsive to the polarity 
j 3 (positive or negative) of the applied electric field. Rather, 
20 the brightness of each pixel's cell is generally only a 

function of the rotation of the polarization of the light 
incident on the cell. As a practical matter, however, it has 
been found that the brightness can vary somewhat between the 
positive and negative field polarities for the same 
25 polarization rotation of the light. Such variation of the 

brightness can cause an undesirable flicker in the displayed 
picture . 

In this embodiment, in the case of either positive or 
negative pictures, as the field driving the cells approaches a 
30 zero electric field strength, corresponding to 8 volts, the 
closer each cell comes to white, corresponding to a full on 
condition. Other systems are possible, for example where the 
common voltage is set to 0 volts. It will be appreciated that 
the inventive arrangements taught herein are applicable to all 
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such positive and negative field LCOS imager driving systems. 

Pictures are defined as positive pictures when the 
variable voltage applied to the tiny plate electrodes is less 
than the voltage applied to the common plate electrode, 
5 because the higher the tiny plate electrode voltage, the 
brighter the pixels. Conversely, pictures are defined as 
negative pictures when the variable voltage applied to the 
tiny plate electrodes is greater than the voltage applied to 
the common plate electrode, because the higher the tiny plate 
10 electrode voltage, the darker the pixels. The designations of 
:| pictures as positive or negative should not be confused with 
|i terms used to distinguish field types in interlaced video 
a * formats . 

Ill The present state of the art in LCOS requires the 

:Ss adjustment of the common-mode electrode voltage, denoted Vito, 
■'^ to be precisely between the positive and negative field drive 
Uj for the LCOS. The subscript ITO refers to the material indium 
[% tin oxide. The average balance is necessary in order to 
j 3 minimize flicker, as well as to prevent a phenomenon known as 
2 0 image sticking. 

.ight engine having an LCOS imager has a severe non- 
:y the display transfer function, which can be 
corrected by a^i^gital lookup table, referred to as a gamma 
table. The gamma t^tjle corrects for the differences in gain 
25 in the transfer functiohs. Notwithstanding this correction, 

the strong non-linearity ofN^ie LCOS imaging transfer function 
for a normally white LCOS image^Nmeans that dark areas have a 
very low light-versus-voltage gain/NsThus, at lower brightness 
levels, adjacent pixels that are only mbc^erately different in 
30 brightness need to be driven by very differfes^t voltage levels. 
This produces a fringing electrical field havin^a component 
orthogonal to the desired field. This orthogonal t^ld 
produces a brighter than desired pixel, which in turn c< 
produce undesired bright edges on objects. The presence oJ 
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such orthdgronal fields is denoted declination. The image 
artifact cau^d by declination and perceived by the viewer is 
denoted sparkleX The areas of the picture in which 
declination occurs\ppear to have sparkles of light over the 
underlying image. InNeffect, dark pixels affected by 
declination are too bright, often five times as bright as they 
should be. Sparkle comes in red, green and blue colors, for 
each color produced by the imagers. However, the green 
sparkle is the most evident whek the problem occurs. 
Accordingly, the image artifact caused by declination is also 
referred to as the green sparkle prdkQ.em. 

is a new technology and green sparkle caused 



^imaging 



6 

by de^T^ation^be^a new kind of problem. Various proposed 
solutions by others irt©iude signal processing the entire 
luminance component of the picture, and in so doing, degrade 
the quality of the entire picture^<tlie trade-off for reducing 
declination and the resulting sparkle isNa^icture with 
virtually no horizontal sharpness at all . Pxbfeure detail and 
sharpness simply cannot be sacrificed in that fashion 

"frl^skilled in the art would expect the sparkle artifact 
problem att^i^uted to declination to be addressed and 
ultimately solve&x^n the imager as that is where the 
declination occurs. Piqwever, in an emerging technology such 
as LCOS, there simply isn ?s ts^an opportunity for parties other 
than the manufacturer of the Lb»§imagers to fix the problem 
in the imagers. Moreover, there is^o indication that an 
imager-based solution would be applicabl^<o all LCOS imagers 
Accordingly, there is an urgent need to providfeva solution to 
this problem that can be implemented without modify^a^^the 
LCOS imagers . 
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Brief Summary of the Invention 
ffle inventive arrangements taught herein solve the 
problem of sparkle in liquid crystal imagers attributed to 
declinatioii without degrading the high definition sharpness of 
the resulting display. Moreover, and absent an opportunity to 
address the pVoblem by modification of imagers, the inventive 
arrangements advantageous ly solve the sparkle problem by 
modifying the violeo signal to be displayed, thus 
advantageously presenting a solution that can be applied to 
all liquid crystal Ymagers, including LCOS imagers. Any 
reduction in detail re advantageously and adjustably limited 
to dark scenes, even ve^ry dark scenes. The video signal is 
signal processed in suchVa way that higher brightness level 
information is advantageoutely unchanged, thus retaining high 
definition detail. At the same time, the lower brightness 
levels of the video signal that directly result in sparkle are 
processed in such a way that th\ sparkle is advantageously 
prevented altogether, or at least\ is reduced to a level that 
cannot be perceived by a viewer. The signal processing of the 
lower brightness level information advantageously does not 
unacceptably degrade the detail of theXhigh definition 
display. Moreover, signal processing iA the form of slew rate 
limiting can advantageously be adjusted oV calibrated in 
accordance with the non-linear gain of any Vamma table, and 
thus, can be used with and adjustably fine tuned for different 
imagers in different video systems. \ 

In a presently preferred embodiment, the luminance signal 
of a picture is decomposed into a higher brightness level 
signal and a lower brightness level signal. The lower 
brightness level signal is slew rate limited to limit the 
difference in brightness levels between adjacent pixels. The 
higher brightness level signal is delayed in time to match the 
processing delay through the slew rate limiter. The delay 
matched higher brightness level signal and the slew rate 
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limited lower brightness level signal are then combined to 
form a modified luminance signal. The demarcation between 
higher and lower brightness levels is adjustable and positive 
and negative slew rates are adjustable. The adjustments are 
5 advantageously independent of one another, and are preferably 
related to transitions between lower gain and higher gain 
portions of the gamma table. 

In a video display system the modified luminance signal 
can be supplied to a color space converter, also referred to 
10 as a matrix, together with the R-Y and B-Y chrominance 
O signals. The chrominance signals are also delayed to match 
!;{ the delay through the sparkle reduction circuit. The outputs 
H of the color space converter are video drive signals, for 
ill example, RGB, supplied to the LCOS imager. The sparkle 
I5 reduction processing of the luminance signal can be expected 
; L to significantly reduce the sparkle problem. 

hj The outputs of the color space converter are video drive 

!"! signals, for example, RGB, supplied to the LCOS imager. In 
another embodiment, one or two or all of the video drive 

20 signals are also subjected to the same sparkle reduction 

processing as is the luminance signal. Video drive signals 
that are not sparkle reduced must be delay matched. The 
modified video drive signals are then supplied to the liquid 
crystal imager. When all of the video drive signals are thus 

25 further processed, the sparkle problem can be reduced even 

further. Each decomposer advantageously has an independently 
selectable brightness level threshold and slew rate limits. 

In yet another embodiment, the luminance signal is not 
sparkle reduced, but one or two or all of the video drive 

30 signals are processed for sparkle reduction. Video drive 

signals that are not sparkle reduced must be delay matched. 
r\2s jnr^elue^odiment, the sparkle reduction processing 

^\^hangls the bright^e^ pixels in the lowest 

brightness levels, corresponding to^H^^iglaest^gain portion 
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of tn^a gamma table, in such a way as to reduce the occurrence 
of declination in the LCOS imager. A threshold for the 
luminance sSonal decomposer, for example, can be expressed as 
a digital fracba^on, for example a digital value of 60 out of a 
5 range of 2 55 digital steps (60/255) , as would be present in an 
8-bit signal. The tnx^shold can also be expressed in IRE, 
which ranges from 0 to rQO in value, 100 IRE representing 
maximum brightness . The IRE level can be calculated by- 
multiplying the digital fraction by 100. The IRE scale is a 
10 convenient way to normalize and compare brightness levels 
-f between signals having different nuftjbers of bits. The value 
"11 of 60, for example, corresponds approximately to 24 IRE. In a 
?s presently preferred embodiment, the threshold value for the 
]f luminance decomposer is 8, corresponding to approximately 3.1 



iSB IRE . 
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Brief Description of the Drawings 



Figure 1 is a block diagram of a sparkle reducing circuit 
in accordance with the inventive arrangements . 

Figure 2 is a block diagram useful for explaining the 
5 operation of a decomposer in Figure 1. 

Figure 3 is a block diagram useful for explaining the 
operation of a delay matching circuit and a slew rate limiter 
in Figure 1 . 



10 display system incorporating different combinations of sparkle 
3 reducing circuits . 

J; Figures 5 (a) -5(e) are waveforms useful for explaining the 

operation of the sparkle reducing circuit. 



Figure 4 is a block diagram of a portion of a video 
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Detailed description of the Preferred Embodiments 
:ircuit for reducing sparkle artifacts attributed to 
decTinatioiv^errors in liquid crystal video systems, for 
example LCOS video systems, is shown in Figure 1 and generally 
denoted by reference numeral 1^. The circuit comprises a 
decomposer 12, a slewN^eLte limiter 22, a delay match circuit 
24 and an algebraic unit\6. An input video signal X, for 
example a luminance signal oi%a video drive signal, is 
modified by the circuit 10, and\n response, an output video 
signal X' is generated. The video signal is a digital signal, 
and the waveform is a succession of digital samples 
representing brightness levels. The output signal X' has a 
similar digital format. The decomposer 12 generates a higher 
brightness level signal 20 and a lower brightness level signal 
18. The operation of decomposer 12 is illustratedNqji Figure 
2 . 

With reference to Figure 2, a block 14 has a first set of 
rules for generating the higher brightness level signal. The 
input signal X represents a succession of brightness level 
samples defining a luminance input signal. The brightness 
level of each sample can be expressed numerically as a digital 
value or an IRE level, for example 60/255 or 24 IRE, as 
explained above. The letter T represents a threshold value, 
which can also be expressed as a digital value or an IRE 
level. If X is greater than T, then the brightness level H of 
the higher brightness level signal is equal to X minus T. If 
X is less than T, then the brightness level H of the higher 
brightness level signal is equal to 0. 

A block 16 has a second set of rules for generating the 
lower brightness level signal. If X is greater than T, then 
the brightness level L of the lower brightness level signal is 
equal to the threshold T. If X is less than T, then the 
brightness level L of the lower brightness level signal is 
equal to X. 
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It may be noted that when X = T, the output of block 14 
will be the same whether X is defined as less than or equal to 
T, or X is defined as greater than or equal to T. In each 
case, H is equal to 0 . It may also be noted that when X = T, 
5 the output of block 16 will be the same whether X is defined 
as less than or equal to T, or X is defined as greater than or 
equal to T. In each case, L is equal to X. 



10 than T, The sum of H + L = X - T + T = X. When X is less than 

□ T, the sum of H + L = 0 +X=X. When X equals T, the sum of 

;^h + l = o+ x = x. 

□ Referring again to Figure 1, the lower brightness level 

m signal 18 is an input to the slew rate limiter 22. The higher 
is brightness level signal 20 is an input to the delay match 
^ circuit 24. The details of the slew rate limiter 22 and the 
hj delay match circuit 24 are shown in Figure 3. Slew rate 

limiter 22 assures that successive output signals from the 
ill slew rate limiter will not vary by more than the predetermined 
5b slew rate. The decomposed LOW signal 18 is an input to an 

algebraic unit 221. The other input to the algebraic unit 221 
is the preceding output of the slew rate limiter stored in 
latch 232. The last output value LOWs is subtracted from the 
input value to determine the difference. The difference on 
25 output line 222 is an input to a first comparator 224 denoted 
MIN and a second comparator 225 denoted MAX. The difference 
is tested in the MIN circuit to see if the difference is 
greater than a positive slew limit S and is also tested in the 
MAX circuit to see if the difference is more negative than the 
30 negative slew limit -S. It is not necessary that the positive 
and negative slew limits have the same absolute value, 
although the same absolute value is used in the embodiment 
shown in Figure 3 . 



It should be appreciated that the sum of the HIGH and LOW 
decomposed signals is always equal to X. When X is greater 
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The most significant bit (MSB) of the difference signal 
222 is the control input to a multiplexer (MUX) 228. The most 
significant bit of the difference indicates the polarity of 
the difference and selects the output 226 of comparator 224 or 
5 the output 227 of comparator 225. The output of the MIN 

comparator is selected when the difference is positive and the 
output of the MAX comparator is selected when the difference 
is negative. The output of the multiplexer on line 229 is a 
slew rate limited difference that is added to the brightness 
10 level of the previous slew rate limited output pixel in 
Q algebraic unit 23 0, in order to generate the next new pixel. 
i%\ The output of the algebraic unit 230 on line 231 is stored in 
F; the latch 232. The output of the latch, LOWs is a stream of 
111 slew rate limited pixels. The embodiment of the slew rate 
! |s limiter shown in Figure 3 incurs a one pixel delay, even if 

the slew rate is not limited. The clock signals are omitted 
UJ from Figure 3 for purposes of clarity. 

\f\ Although the positive and negative slew rates in the 

O example shown in Figure 3 have the same absolute value, this 

20 need not be the case. Advantageously, the slew rates can be 

set independently for sample values greater than the preceding 
sample value and for sample values less than the preceding 
pixel value. If the positive and negative slew rates are 
equal to 1, for example, then successive outputs of the slew 
25 rate limiter will not differ from one another by more than 1 
digital value step. If the LOW signal has an 8-bit value, 
then successive outputs of the slew rate limiter will not 
differ from one another by more than one step out of 256 
states, representing 255 steps. 
30 The one pixel delay of the slew rate limiter corresponds 

to a one clock period delay, and accordingly, the delay match 
circuit 24 provides a one clock period delay for the higher 
brightness level signal. It is possible under some 
circumstances that the delay incurred by the slew rate limiter 
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can exceed one clock period delay, but the delay match circuit 
need not be adjusted accordingly. The slew rate limited lower 
brightness level signal LOWs and the delayed higher brightness 
level signal are combined in the algebraic unit 26, which 
5 generates the output signal X' . 

A video system 3_0 shown in Figure 4 illustrates various 
combinations in which video signals, for example luminance 
signals and video drive signals, can be processed for sparkle 
reduction. A color space converter, or matrix, 32 generates 
10 video drive signals, for example RGB, responsive to a 
4: luminance signal, denoted LUMA, and chrominance signals, 
ill denoted CHROMA. The chrominance signals are more particularly 
l7l designated R-Y and B-Y. 

ill Two sets of inputs to the color space converter 32 are 

lis denoted 34A and 34B. In set 34A the LUMA signal input is 
!=! modified by sparkle reduction processor (SRP) 10 to generate 
j ^ LUMA' . The CHROMA signals are delayed by delay match (DM) 
= 11 circuits 36. In set 34B the LUMA signal is not modified and 
!"f the CHROMA signals are not delay matched. 

20 Four sets of outputs from the color space converter 32 

are denoted 40A, 40B, 40C and 40D. In set 40A the video drive 
signals RGB are not modified. In set 40B, each one of the RGB 
video drive signals is modified by a sparkle reduction 
processor 10. No delay matching is necessary. In set 40C 

25 only one of the video drive signals, for example G, is 

modified by sparkle reduction processor 10 to generate G' . 
The remaining video drive signals are delayed by delay 
matching circuits 36. In set 40D only two of the video drive 
signals, for example R and G, are modified by sparkle 

3 0 reduction processors 10 to generate R' and G' . The remaining 
video drive signal is delayed by delay matching circuit 36. 
Input set 34A can be used with any one of output sets 40A, 
4 0B, 40C or 40D. Input set 34B can be used with any one of 
output sets 40B, 40C or 40D. The combination of input set 34B 
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and output set 40A does not include sparkle reduction 
processing . 

nxtNJias been found that using the combination of input set 
34A artCT^oub^ut set 40A can significantly reduce the sparkle 
artifact attributed to declination. It has also been found 
that using the coH±>ination of input set 34A and output set 40B 
can reduce the sparine attributed to declination even further. 
This substantial reductixm advantageously solves the sparkle 
problem for all practical purposes . It should be appreciated 
that although the sparkle reduction processing circuits in 
Figure 4 can be identical to one another, the threshold value 
and the slew rate limits for each ofNthese sparkle reduction 
processing circuits can advantageously independently 
selected. This enables the sparkle reduction processing to be 
fine tuned to the different video signals. \ 

The response of circuit 10 in Figure 1 to a specific 
input signal is illustrated in Figures 5(a) through 5(e). For 
purposes of illustration, the threshold T is set to the 
digital value or state of 8, corresponding to approximately 
3.1 IRE for an 8-bit signal. The positive slew rate is the 
digital value or state of + 2, and the negative slew rate is 
-2. A state or value of 2 corresponds approximately to 0.7 
IRE in an 8-bit signal. The waveforms of Figures 5 (a) -5(e) 
are aligned in time to demonstrate the delays incurred by the 
low pass filtering and the delay match circuit. The first 
samples in each of Figures 5(a) and 5(c) are aligned with one 
another. The first samples of Figures 5(b), 5(d) and 5(f) are 
aligned with one another. 

In Figure 5(a) an input signal X has the luminance values 
shown by the black dots. Some IRE equivalents are provided. 
Each black dot represents a sample of a luminance value as an 
input to the decomposer 12 . Each sample represents the 
brightness level of a pixel. The signal X can be seen as 
including a pulse followed by an impulse. The threshold value 
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of T, as explained in connection with the rules of Figure 2, 



is equal to 8 in this example. The slew rate limits of the 
slew rate limiter are set to 2 and to -2. Accordingly, 
successive output samples of the slew rate limiter cannot vary 



The first two values of X are 0. In accordance with 
block 14, the value of the delay matched higher brightness 
level signal HIGHd shown in Figure 5 (b) is 0 because X is less 
10 than T. The next three input values are 20. The 
z! corresponding levels of the higher brightness level signal in 
S Figure 5 (b) are 12 because the output value equals the input 
value minus the threshold value (X-T) . The remaining sample 
tj values are calculated in the same fashion. 
lis With reference to Figure 5(c), the first two output 

values of the lower brightness level signal LOW are 0, because 
j the input is less than the threshold and the output equals the 
% input . The next three output values are equal to 8 because 
J the input value is greater than the threshold, and in this 
20 case, the output equals the threshold value. The remaining 
samples are calculated in the same fashion. 

Figure 5(d) represents the output LOW s of slew rate 
limiter 22 responsive to the signal shown in Figure 5(c) . The 
values of the first and second samples of LOW are 0. Since 0 
25 is less than 2, the values of the first two samples of LOWs 
are 0. The value of the third sample of LOW is 8. Since 8 
exceeds 0 by more than the slew limit of 2, the value of the 
third sample of LOWs is 2. The value of the fourth sample of 
LOW is 8. Since 8 exceeds 2 by more than the slew limit of 2, 
30 the value of the fourth sample of LOWs is 4. The value of the 
fifth sample of LOW is 8. Since 8 exceeds 4 by more than the 
slew limit of 2, the value of the fifth sample of LOWs is 6. 
The value of the sixth sample of LOW is 0. Since 0 is less 



5 from one another by more than two digital steps, approximately 



0.7 IRE . 
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than 6 by more than the slew limit of 2, the value of the 
sixth sample of LOWs is 4. The value of the seventh sample of 
LOW is 0. Since 0 is less than 4 by more than the slew limit 
of 2, the value of the seventh sample of LOWs is 2. The value 
of the eighth sample of LOW is 0. Since 0 is not less than 2 
by more than the slew limit of 2, the value of the seventh 
sample of LOWs is 0 . The value of the ninth sample of LOW is 
8. Since 8 exceeds 0 by more than the slew limit of 2, the 
value of the ninth sample of LOWs is 2. The value of the 
tenth sample of LOW is 0. Since 2 does not exceed 0 by more 
than the slew limit of 2, the value of the tenth sample of 
LOWs is 0. The value of the eleventh sample of LOW is 0. 
Since 0 does not exceed 0 by more than the slew limit of 2, 
the value of the eleventh sample of LOWs is 0. It can be 
noted that the edges or transitions of the pulse and impulse 
which were still evident in the waveform of Figure 5(c) have 
been almost completely smoothed, or rolled off, by the slew 
rate limiting. 

Finally, Figure 5(e) is the output signal X', which is 
the sum of the waveforms in Figures 5(b) and 5(d) . It can be 
noted from the waveform in Figure 5(e) that the essential 
character of the pulse and of the impulse in the input 
waveform X has been retained in the output waveform X' , but 
sharp edges or transitions between adjacent sample values have 
been advantageously reduced. The roll off is most evident in 
the leading edge of the output pulse. Only the very dark 
areas of the picture are noticeably affected by the sparkle 
reduction processing, as evidenced by the very low values of 
the threshold and the slew rate limits. Accordingly, the high 
definition horizontal resolution is advantageously maintained. 

The methods and apparatus illustrated herein teach how 
the brightness levels of adjacent pixels can be restricted or 
limited in the horizontal direction, and indeed, these methods 
and apparatus solve the sparkle problem. Nevertheless, these 
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methods and apparatus can also be extended to restricting or 
limiting brightness levels of adjacent pixels in the vertical 
direction, or in both the horizontal and vertical directions. 
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